On Classification: Simultaneously Reducing Dimensionality and Finding Automatic Representation using Canonical Correlation
نویسنده
چکیده
This report describes an idea based on the work in [1], where an algorithm for learning automatic representation of visual operators is presented. The algorithm in [1] uses canonical correlation to find a suitable subspace in which the signal is invariant to some desired properties. This report presents a related approach specially designed for classification problems. The goal is to find a subspace in which the signal is invariant within each class, and at the same time compute the class representation in that subspace. This algorithm is closely related to the one in [1], but less computationally demanding, and it is shown that the two algorithms are equivalent if we have equal number of training samples for each class. Even though the new algorithm is designed for pure classification problems it can still be used to learn visual operators as will be shown in the experiment section.
منابع مشابه
Dimensionality Reduction and Improving the Performance of Automatic Modulation Classification using Genetic Programming (RESEARCH NOTE)
This paper shows how we can make advantage of using genetic programming in selection of suitable features for automatic modulation recognition. Automatic modulation recognition is one of the essential components of modern receivers. In this regard, selection of suitable features may significantly affect the performance of the process. Simulations were conducted with 5db and 10db SNRs. Test and ...
متن کاملDiagnosis of Diabetes Using an Intelligent Approach Based on Bi-Level Dimensionality Reduction and Classification Algorithms
Objective: Diabetes is one of the most common metabolic diseases. Earlier diagnosis of diabetes and treatment of hyperglycemia and related metabolic abnormalities is of vital importance. Diagnosis of diabetes via proper interpretation of the diabetes data is an important classification problem. Classification systems help the clinicians to predict the risk factors that cause the diabetes or pre...
متن کاملMethods of Canonical Analysis for Functional Data
We consider estimates for functional canonical correlations and canonical weight functions. Four computational methods for the estimation of functional canonical correlation and canonical weight functions are proposed and compared, including one which is a slight variation of the spline method proposed by Leurgans, Moyeed and Silverman (1993). We propose dimension reduction and dimension augmen...
متن کاملIdentification of Risk Factors by Using Macroeconomic and Firm-Specific Variables Simultaneously in Tehran Stock Exchange by Applying Canonical Correlation Analysis
The main objective of this study is to give the insight of describing mixing accounting ratios and macroeconomic variables as the risk factors in Iran. The results indicate a significant relationship between book to market ratio, financial leverage, size factors and expected stock returns in the Iranian market. In consistent with the other studies, we came to the conclusion that the term struct...
متن کاملUnderstanding the Interplay of Simultaneous Model Selection and Representation Optimization for Classification Tasks
The development of classification systems that meet the desired accuracy levels for real world-tasks applications requires a lot of expertise. Numerous challenges, like noisy feature data, suboptimal algorithms and hyperparameters, degrade the generalization performance. On the other hand, almost countless solutions have been developed, e.g. feature selection, feature preprocessing, automatic a...
متن کامل